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W&A  Special  Session  Purpose 


•  Leverage  existing  Government  and  Industry  W&A 
knowledge  to  improve  MDA  W&A  for  T&E  M&S 

•  Topics  for  Today’s  Session: 

-  (1)  The  Referent;  building  the  body  of  knowledge 
about  the  system  under  study  to  increase 
confidence  in  the  validity  of  the  M&S 

-  (2)  Acceptabiiity  Criteria;  formuiating  the 
comparison  points  and  M&S  accuracy  requirements 

-  (3)  Documentation;  rolling  up  the  right  amount  of 
historical  and  newly  formulated  information 

•  Additional  discussion  topic,  time  permitting:  Validation 
Process  Maturity  Model  (VPMM) 
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MDA  Referent  Challenges 


*  Testing  of  the  BMDS  is  costly  and  highly  constrained 

-  Catch  22:  not  enough  test  data  drives  need  for  M&S 

-  Not  enough  test  data  inhibits  extensive  validation 

*  How  to  leverage  Ground  Testing  to  the  fullest  extent  to 
provide  referent  data 

-  Ground  tests  are  valuable  analysis  venues  making  it 
difficult  to  align  configurations  for  M&S  validation 

-  Ground  Tests  are  also  expensive,  requiring  HWIL, 
planners,  operators,  etc. 
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Acceptability  Criteria  Issues 


•  Building  appropriate  acceptability  criteria  requires 
extensive  knowledge  about  the  system 

-  Another  Catch  22:  lack  of  confidence  in  system  M&S 
makes  sensitivity  analysis  unreliable 
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Documentation  Issues 


*  Documenting  is  time  consuming,  not  in  development 
critical  path 

-  Tends  to  be  the  first  item  cut  with  budget  cuts 

*  Too  much  documentation,  not  focused  on  critical 
information,  inhibits  the  amount  of  knowledge  that  can 
be  conveyed 

*  Inconsistent  document  formats  limits  the  ability  to 
easily  archive  and  retrieve  historical  knowledge 
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